Papers with approximation theory
Barriers to Discrete Reasoning with Transformers: A Survey Across Depth, Exactness, and Bandwidth (2026.eacl-long)
Copied to clipboard
Michelle Yuan, Weiyi Sun, Amir H. Rezaeian, Jyotika Singh, Sandip Ghoshal, Yao-Ting Wang, Miguel Ballesteros, Yassine Benajiba
| Challenge: | despite advances in transformers, their theoretical limitations in discrete reasoning remain a critical open problem. |
| Approach: | They synthesize recent advances from three theoretical perspectives to clarify structural and computational barriers transformers face when performing symbolic computations. |
| Outcome: | The proposed models excel at pattern matching and interpolation, but they face bottlenecks in communication and depth constraints. |